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SECftQN  1 
INTRODUCTION 


1.1  PURPOSE 

3 

Improvements  in  Communications,  Command  and  Control  (C  ) System 
reliability  and  throughput  can  be  achieved  through  the  incorporation 
of  error  correction  coding.  Specifically,  the  control  of  transmission 
errors  induced  by  channel  characteristic  variations,  equipment  per- 
formance inconsistencies,  and  man-made  interference  whether  uninten- 
tional (e.g.,  machine  noise)  or  intentional  (e.g.,  jamming),  is  the 
primary  objective  of  error  coding.  This  paper  details  the  design  of 
a single  forward  - error  correcting  decoder  based  on  a low-cost  LSI 
circuit  - the  microprocessor. 

1.2  BACKGROUND 


Project  7010  (Low  Cost  Electronics)  is  investigating  new  LSI 
technologies  and  their  suitability  for  increasing  the  performance  of 

3 

C systems  and  lowering  life-cycle  costs.  Error  correction  roding 
can  be  a very  effective  system  design  element  in  achieving  increased 
levels  of  system  reliability  and  throughput.  In  the  past,  error  cod- 
ing has  not  been  regularly  employed  in  system  designs  because  of  the 
complexity  and  cost  of  its  implementation.  With  the  advent  of  low- 
cost  LSI  circuits  and  fairly  recent  advances  in  coding  theory,  this 
situation  is  rapidly  changing.  In  order  to  exploit  these  developments. 
Project  7010  has  been  investigating  low-cost  implementations  of  simple 
error  coding  techniques  Attention  has  been  recently  focused  on  non- 
binary cyclic  codes,  and  specifically  the  Reed-Solomon  (R-S)  Codes. 
Studies  already  completed  have  shown  that  the  use  of  R-S  codes  on 

r ' 
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approximated  communication  channels  leads  to  improved  comnunlcatlon 
throughput  and  therefore  enhanced  system  operation.  Details  con- 
cerning the  conceptual  work  behind  utilizing  NMOS  microprocessors  for 
decoding  short  block  codes,  specifically  the  (7,3)  R-S  code,  can  be  , 

found  in  Volume  I of  this  report. ^ 

1.3  SCOPE  / 

This  paper  details  the  design,  operation,  and  testing  of  a table- 
search  microprocessor-based  (7,3)  R-S  decoder.  The  microprocessor 
host  system  hardware  and  software  design  is  detailed  in  an  Engineering 
Record.  Decoder  operations  are  fully  illustrated  including  spe- 
cific examples  of  decoding  beyond  the  bounds  of  the  (7,3)  R-S  code. 

Error  and  erasure  handling  performance  Is  explained  as  It  affects  de- 
coder throughput  and  performance.  Lastly,  decoder  test  results  are 
presented  for  complete  and  exhaustive  error  pattern  testing  and  Monte 
Carlo  simulated  error  environments.  These  results  are  analyzed  and 
conclusions  drawn  relative  to  three  main  decoder  performance  criteria: 
decoding  rate,  delay  and  buffering. 
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SECTION  2 


DECODER  IMPLEMENTATION 


The  actual  (7,3)  Reed-Solomon  decoder  hardware  is  but  a small 
subset  of  the  system  hardware  used  to  interactively  exercise  and  test 
the  decoder.  The  (7,3)  Reed-Solomon  decoder  software  executes  as  an 
application  program  on  an  MC6800  microprocessor-based  host  (support) 
system  (Figure  2-1).  The  host  system's  electrical  design,  software, 
and  operation  is  detailed  in  another  document.  This  section  details  the 
basic  design  of  the  (7,3)  Reed-Solomon  decoder  hardware  (i.e.,  the 
MC6800  microprocessor  card)  and  its  associated  decoding  software. 
Additionally,  interactive  decoder  operation  is  completely  demonstra- 
ted through  six  specific  decoding  examples. 

2.1  DECODER  HARDWARE 

The  amount  of  hardware  necessary  to  implement  the  (7,3)  R-S  de- 
coder represents  a small  amount  of  the  total  host  system  hardware. 

In  fact,  the  entire  decoding  algorithm  is  executed  by  only  six  chips 
on  the  host  system's  Central  Processing  Unit  (CPU)  card.  This  mini- 
mum chip  set  (indicated  in  Figure  2-2  by  the  chips  with  light  gray 
labels)  implementation  consists  of  a CPU,  clock,  1 RAM,  and  3 EPROMS. 
Figure  2-3  is  a block  diagram  of  the  (7,3)  R-S  decoder  hardware.  The 
code  table  occupies  1536  bytes  (two  IK  EPROMs),  while  the  actual  de- 
coder program  requires  about  256  bytes  of  a third  EPROM.  The  tempo- 
rary RAM  storage  requirement  is  approximately  20  bytes.  Due  to  the 
small  amounts  of  program,  table  and  data  storage,  this  specific  de- 
coder implementation  could  utilize  one  of  the  recently  introduced 
one-chip  microcomputers  such  as  Mostek's  3870  shown  in  the  micro- 
photograph of  Figure  2-4. 


"» — mrtr 


FIGURE  2-1:  MC6800  MICROPROCESSOR  DEVELOPMENT  FACILITY 


FIGURE  2-2:  MC6800  CPU  CARD 
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FIGURE  2-4:  MOSTEK  3870  ONE-CHIP  MICROCOMPUTER 
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2.2  DECODER  SOFTWARE 

The  decoding  algorithm  implemented  in  the  (7,3)  R-S  decoder  is 
a table  search  method  based  on  Maximum  Likelihood  or  Minimum  Distance 
Decoding^-1-.  Basically,  it  consists  of  comparing  a received  (cor- 
rupted) codeword  against  a table  of  all  possible  codewords  and  choos- 
ing that  table  codeword  which  is  most  like  (i.e.,  minimum  distance 
away  from)  the  received  (corrupted)  codeword.  Clever  codetable  re- 
presentation, table  search,  and  structured  program  techniques  were 
applied  to  achieve  maximum  decoder  throughput. 


2.2.1  (7,3)  R-S  Code  Representation 


Figure  2-5  illustrates  the  block  structure  of  the  (7,3)  R-S 
codeword.  Each  codeword  is  comprised  of  7 symbols,  each  of  which  may 
•"epresent  any  one  of  eight  levels.  In  the  encoding  operation  the 
first  three  symbols  are  set  to  correspond  exactly  to  the  desired 
message,  and  the  last  four  symbols,  called  parity  check  symbols,  are 
calculated  and  appended  for  error  correction.  Codes  of  this  type  are 
termed  Systematic.  The  coding  theory  of  linear  cyclic  BCH  codes,  and 
particularly  Reed-Solomon  codes,  states  that  the  codeword  symbols  of 
the  (7,3)  R-S  code  are  elements  of  an  extended  Galois  Field 
GF(2  )L  ’ J.  By  picking  an  irreducible  primitive  polynomial  of 
degree  m=3,  the  eight  finite  field  elements  (code  symbols)  may,  as 
illustrated  in  Figure  2-5,  be  represented  as  3-tuples  over  the  binary 
base  field  GF(2l.  This  is  the  manner  in  which  the  code  symbols  are 
represented  in  the  decoding  program. 

It  is  then  necessary  to  pack  the  seven  code  symbols  of  each 
codeword  into  8-bit  bytes  for  efficient  data  manipulation  and  code- 
table storage.  Since  there  are  k * 3 Information  symbols  per  code- 
word, and  each  symbol  can  represent  any  of  the  q * 8 levels,  the 
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Figure  2-5  : (7,3)  REED  SOLOMON  CODEWORD  STRUCTURE 
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maximum  number  of  unique  messages  and  hence  codewords  is  q = 8 = 

512.  Figure  2-6  illustrates  the  manner  in  which  the  finite  field 
element  codewords  are  represented  in  the  binary  realm  of  the  micro- 
processor. Each  of  the  512  codewords  contains  7 symbols.  Since 
each  symbol  can  be  any  one  of  eight  values,  codeword  storage  requires 
3 bits  per  symbol  or  21  bits  per  codeword.  These  21  bits  can  be 
packed  into  three  8-bit  bytes  with  three  bits  left  over  as  shown  in 
Figure  2-6.  The  implementation  scheme  for  codeword  representation 
is  highly  microprocessor  dependent.  The  representation  scheme  illus- 
trated in  Figure  2-6  has  been  optimized  for  maximum  efficiency  when 
utilized  with  the  Motorola  6800  microprocessor.  It  will  be  noted 
that  six  of  the  seven  codeword  symbols  are  located  in  the  same  rela- 
tive positions  in  the  three  bytes,  while  the  seventh  symbol  occupies 
a unique  position.  This  seventh  symbol  is  (of  necessity)  split 
between  two  bytes. 

The  split  has  been  coded  to  take  advantage  of  the  easy  test- 
ability of  bit  #7,  the  sign  bit  of  the  microprocessor's  accumulator 
register  (a  status  bit  common  to  all  microprocessors).  Codeword 
symbol  #6-bit  C2q  is  positioned  in  that  location.  Using  the  first 
three  information  symbols  of  the  systematic  code  to  form  a table 
entry  vector,  the  table  search  is  initiated  at  that  point.  This 
assumes  that  these  symbols  were  received  correctly,  a valid  assumption 
in  the  majority  of  cases  involving  "decent"  error  rates  (e.g.,  better 

_3 

than  10  ).  Maximizing  correct  table  entry  increases  throughput 

because  it  minimizes  table  search  time,  in  most  cases  resulting  in 
only  one  table  look-up  operation. 

Since  the  (7,3)  R-S  code  is  a valid  cyclic  code,  the  codetable 
storage  could  have  been  reduced  by  85.55%  by  taking  advantage  of  the 
cyclic  properties  of  the  code.  Alternative  programs  were  written 
using  this  method,  but  were  found  to  adversely  affect  the  decoding 
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rate  due  to  the  overhead  required  for  cyclic  shifts.  Nevertheless, 
this  alternative  does  represent  an  interesting  tradeoff  of  decoding 
speed  vs.  storage  requirements  particularly  when  considering  imple- 
mentations of  longer  codes.  Another  alternative  is  the  storage  of 
only  4 code  symbols  instead  of  7,  since  every  (7,3)  R-S  codeword  is 

uniquely  defined  by  any  three  symbols.  This  would  reduce  codetable 
storage,  but  would  require  received  codeword  permutations  to  govern 
the  compares  and  ensure  error/erasure  correction.  However,  the 
maximum  number  of  compares  would  be  dramatically  reduced,  making 
this  an  attractive  tradeoff. 

2.2.2  The  Decoding  Algorithm 

A basic  flowchart  of  the  (7,3)  R-S  decoding  algorithm  is  shown 

in  Figure  2-7.  Decoding  operation  is  explained  using  this  flowchart. 

A received  (possibly  corrupted)  codeword  is  stored  in  scratchpad 

memory  in  the  three  byte  format  shown  in  Figure  2-6.  It  is  assumed 

that  the  demodulator  has  converted  the  received  m-ary  symbols  into 

their  corresponding  binary  equivalents  and  transmits  the  received 

codeword  (i.e.,  a block  of  three  8-bit  bytes)  to  the  microprocessor 

along  with  a fourth  byte  indicating  which,  if  any,  symbols  have  been 

★ 

declared  erasures.  Erasure  declaration  is  assumed  to  include  a 
"best  guess"  at  the  received  symbol.  It  is  further  assumed  that, 
since  decoding  time  is  a function  of  the  corrupting  error  pattern. 

It  is  not  constant,  and  therefore,  a system  buffer  must  be  employed 
to  store  received  codewords  while  other  codewords  are  being  decoded 
(see  4.1.2). 


* 

An  ERASURE  is  a symbol  that  is  known  to  be  In  error.  This  simpli- 
fies the  decoding  task  because  the  symbol  location  of  the  error  is 
known,  and  it  then  remains  to  determine  the  value  of  the  error. 
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The  microprocessor  first  evaluates  the  number  of  symbols  that 
the  demodulator  has  declared  as  erasures.  Maximum  likelihood  decod- 
ing provides  for  the  correction  of  a maximum  of  twice  as  many  erased 
symbols,  in  the  absence  of  any  errors,  as  the  error  correction  capa- 
bility (t)  of  the  linear  block  code.  Should  the  number  of  erasures 
(E)  exceed  2t,  then  the  received  codeword  cannot  be  decoded  and 
further  decoding  operations  on  this  received  codeword  are  a waste  of 
decoder  time.  The  microprocessor,  recognizing  this  event, does  not 
attempt  any  further  decoding  operations  and  simply  outputs  the  code- 
word as  received  and  proceeds  to  decode  the  next  received  codeword. 

Next,  a so-called  "Exit-Constant"  (D  ) is  calculated.  From  a 

ex 

simple  proof  of  Maximum  Likelihood  Decoding  it  can  be  shown  that  for 
Ml 

correct  decoding1-  J 

2t  + s £ d - 1 (1) 

t = the  number  of  symbol  errors  In  a received  codeword 
s = the  number  of  erasures  In  a received  codeword 
d = the  minimum  Hanmlng  distance  of  the  linear  block  code 

For  the  (7,3)  R-S  code  d = 5.  Shown  In  Table  I are  the  possible 
combinations  of  the  number  of  symbols  in  error  and/or  erased  in  any 
single  received  codeword  that  can  be  corrected. 


♦Minimum  Hanmlng  distance  Is  the  least  number  of  symbols  by  which 
any  two  codewords  differ. 
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Table  I 

(7,3)  R-S  Correctable  Error/Erasure  Patterns 


No.  of  Errors 
0 
0 
0 
0 
1 
1 
1 
2 


No.  of  Erasures 
1 
2 

3 

4 
0 
1 
2 
0 


Given  the  number  of  erasures  in  a received  codeword  and  the  minimum 
Hamming  distance  of  the  code,  equation  (1)  can  be  manipulated  into: 

t < (d  - 1 - s)/2  (2) 

For  correct  maximum  likelihood  decoding,  t is  the  maximum  number  of 
symbol  errors  allowed  in  a received  codeword  given  s known  erased 
symbols.  The  truncated  integer  value  of  t will  be  defined  as 
Dex  the  exit  constant.  The  utility  of  this  exit  constant  will  become 
evident  later  in  the  description  of  the  decoding  algorithm. 

The  codeword  table  provides  valid  codewords  for  comparison  with 
a received  codeword.  The  table  search  procedure  has  been  structured 
to  minimize  the  number  of  codewords  that  must  be  accessed  and  com- 
pared. This  table  search  optimization  is  accomplished  by  beginning 
the  search  assuming  the  received  codeword  is  a valid  codeword  and 
entering  the  table  at  exactly  that  entry.  A table  entry  pointer  Is 
calculated  from  the  three  message  symbols  of  the  received  codeword 
(bits  c-|2  - C£q  In  Figure  2-6).  Note  that  with  the  codeword 
representation  scheme  of  Figure  2-6,  a one  bit  rotate-left  operation 
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on  byte  2 of  the  received  codeword  sets  up  the  testing  of  three  bits 
of  symbol  6,  i.e.,  C^g  * C^q,  since  C^g  end  ^2q  in  the  sign 
position  of  the  bytes  and  Clg  is  in  the  carry.  This  efficient  method 
results  in  the  quick  calculation  of  a table  entry  point.  It  way  be 
noted  that  no  rotate  operation  would  be  required  at  all  if  bit  C-jg 
were  located  in  the  most  significant  (sign)  bit  of  byte  0.  While 
this  is  true,  that  arrangement  could  result  in  abnormally  difficult 
compare  operations  involving  symbol  6 later  on  in  the  program.  If 
the  received  codeword  is  correct,  or  if  all  errors  and  erasures  are 
confined  to  the  parity  check  symbols,  the  table  entry  procedure  will 
result  In  only  one  fetch  operation,  i.e.,  the  processor  points  to  the 
described  correct  codeword  immediately. 

Using  this  table  entry  point,  the  microprocessor  fetches  one 
valid  codeword  from  the  table  (three  bytes).  The  selected  codeword 
is  compared  symbol -by-symbol  (not  counting  erased  symbols)  with  the 
received  codeword  and  the  number  of  symbol  discrepancies  D (number 
of  symbols  that  are  different)  Is  found.  The  number  of  symbol  dis- 
crepancies D is  compared  with  the  previously  calculated  exist  con- 
stant Dex.  If  at  any  stage  during  the  decoding  operation,  it  is  dis- 
covered that  a valid  codeword,  I.e.,  an  entry  from  the  codeword 
table,  differs  from  th.  received  codeword  by  a number  of  symbols 
(not  counting  erased  symbols)  which  Is  less  than  or  equal  to  the 
exist  constant.  Maximum  Likelihood  Decoding  guarantees  that  there 
are  no  other  valid  codewords  which  are  any  more  likely.  If  D Dgx, 
then  the  most  likely  codeword  has  been  located  and  it  is  declared 
the  decoded  codeword.  Should  D not  be  less  than  or  equal  to  Dgx, 

D Is  compared  with  Dm^n,  the  least  value  of  D found  to  that  point 
in  the  decoding  procedure  for  that  particular  received  codeword.  If 
the  latest  D Is  less  than  or  equal  to  Dm^n»  ft  Is  specifically  tested 
for  equality.  If  D Is  found  to  exactly  equal  w it  means  that 
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another  valid  codeword  of  distance  D = D away  from  the  received 
codeword  has  been  found.  This  situation  cannot  exist  for  any  cor- 
rectable error  and  erasure  patterns  or  for  patterns  which  corrupt 
a transmitted  codeword  so  badly  that  it  is  mapped  closer  to  another 
valid  codeword  than  the  one  which  was  originally  transmitted  (the 
weight  of  the  corrupting  error  pattern  exceeds  one-half  the  minimum 
Hamming  distance  of  the  code).  There  are,  however,  error  patterns 
whose  weight  exceeds  the  number  of  allowable  symbol  errors  and  also 
are  an  equal  distance  from  several  valid  codewords.  The  algorithm 
detects  such  patterns  and  therefore  represents  an  "attempt"  at  decoding 
beyond  the  bounds  of  the  code.  This  is  only  an  "attempt",  because 
the  ambiguity  register  indicates  how  many  ambiguous  codewords  there 
are  in  these  instances,  and  a list  of  the  codewords  is  available 
as  output  (see  example  No.  5,  Figure  2-12). 

At  this  point  if  D f Dm1n»  It  must  be  that  D < Dml-n  so  that 
a new  P|n^n  is  declared  equal  to  the  D just  found,  and  all  previous 
ambiguity  information  is  erased.  The  address  of  the  codeword  found 
is  saved  for  later  output  If  no  more  likely  codeword(s)  are  sub- 
sequently found. 

The  next  decision  block  in  the  flowchart  asks  if  the  entire  512 
entries  in  the  codeword  table  have  been  searched.  (This  poln^  Is 
reached  Immediately  if  D had  been  found  to  be  not  less  than  a pre- 
viously declared  Dmin.)  If  the  answer  is  no,  the  table  pointer  is 
incremented  and  the  next  valid  codeword  is  fetched  from  the  table. 

If  the  answer  is  yes,  the  decoder  outputs  the  best  minimum  distance, 
(number  of  discrepancies)  found  and  all  the  valid  codewords  at  that 
distance.  Note  that  this  program  exit  point  only  occurs  for  codes 
with  t > 2 (i.e. , beyond  the  correctable  bounds  of  the  (7,3)  R-S 
code),  and  results  in  an  ambiguity  in  the  possible  transmitted  code- 
word. Had  the  error  pattern  with  weight  greater  than  2 corrupted  the 
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transmitted  codeword  so  badly  that  it  was  "mapped"  closer  to  another 
valid  codeword,  the  algorithm  exit  point  would  have  been  from  the 
0 5.  0ex  decision  block,  and  the  decoder  would  never  have  recognized 
that  it  decoded  to  the  wrong  codeword.  Indeed,  the  decoder  sees  this 
as  simply  an  example  of  decoding  an  allowable  error  pattern. 

The  main  time  consuming  loop  in  this  algorithm  is  between  the 
"Last  C in  table?"  decision  block  and  the  "Fetch  codeword  (C)  from 
table"  block.  This  is  the  most  vigorously  optimized  loop  and  is  that 
part  of  the  algorithm  which  is  timed  for  purposes  of  estimating  the 
decoding  rate. 

2.3  DECODER  OPERATION 


The  (7,3)  R-S  decoder  was  specifically  designed  for  interactive 
operation  and  testing.  As  such,  an  operator  is  able  to  choose  any 
single  codeword  and  error/erasure  pattern  and  observe  the  results  of 
the  decoding  operation.  Alternatively,  an  operator  can  exhaustively 
generate  all  possible  codeword  - error/erasure  pattern  combinations 
or  initiate  random  selection  of  these  parameters.  To  illustrate  de- 
coder operation  and  performance,  six  examples  will  be  explained. 
These  examples  have  been  carefully  selected  to  show  the  results  of 
decoding  different  error/erasure  patterns  on  randomly  selected  code- 
words. The  performance  assessment  parameters  of  the  decoding  opera- 
tion are  available  via  the  decoder  information  fields  displayed  on  a 
video  monitor. 
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2.3.1  Example  1 - No  Errors  and  Erasures 

Figure  2-8  illustrates  the  monitor  display  for  the  case  of  a 
transmitted  codeword  that  was  not  corrupted  by  any  errors  or  erasures, 
i.e.,  a correctly  received  codeword.  The  program  first  prompts  the 
operator  for  an  "Input  Message".  The  operator  inputs  three  message 
symbols  in  their  binary  representation,  in  this  case  100  100  101. 

The  program  uses  this  message  to  calculate  a codeword  table  entry 
point.  The  entire  codeword  is  read  out  of  the  table  and  displayed 
on  the  screen  as  the  "Encoded  Codeword":  100  100  101  111  101  110 
111.  Thus,  codeword  encoding  is  simply  a table  lookup  procedure 
whereby  a systematic  codeword  is  produced.  The  system  then  prompts 
the  operator  to  "Input  Error  and  Erasure  Pattern".  The  operator  may 
indicate  an  error  by  typing  in  a "1",  no  error  as  a "0",  or  an  erased 
symbol  by  an  "e".  Once  one  of  the  equivalent  symbol  bits  has  been 
declared  in  error,  the  entire  symbol  is  in  error.  The  system  next 
corrupts  the  encoded  codeword  with  the  specified  error  pattern  (an 
X0R  operation)  and  displays  the  result  as  the  "Received  Codeword". 

This  simulates  the  reception  of  a corrupted  transmitted  codeword  by 
the  decoder.  The  system  (playing  the  part  of  a demodulator)  forms  a 
byte  containing  information  pertaining  to  the  symbols  which  have  been 
specified  (declared)  erasures  and  hands  this  byte,  along  with  the 
three  byte  received  codeword  (see  Figure  2-6),  to  the  decoder.  It  is 
at  this  point  that  the  actual  decoding  algorithm  begins  and  the  timer 
is  started.  The  decoder  has  no  a priori  knowledge  of  the  selected 
message  sequence  or  of  the  chosen  error/erasure  pattern.  It  merely 
takes  the  received  codeword,  calculates  a table  entry  point  from  the 
message  symbols,  and  starts  the  table  search  and  compare  operations 
at  that  point.  In  this  case,  since  there  are  no  errors  or  erasures, 
the  table  entry  point  is  the  correct  codeword.  Comparison  with  the 
received  codeword  shows  no  discrepancies,  i.e.,  zero  symbols  are 


unalike,  and  therefore  the  codetable  word  pointed  to  is  declared  the 
"Decoded  Codeword".  The  remaining  performance  assessment  information 
displayed  indicates  that,  as  a result  of  the  decoding  operation,  the 
decoder  found  no  symbol  errors  or  erasures  and  found  one  codeword 
that  was  distance  zero  (i.e.,  an  exact  match)  away  from  the  received 
codeword.  This  codetable  word  was  declared  the  "Decoded  Codeword", 
output,  and  the  timer  stopped.  The  display  shows  a decoding  "kernel" 
(table  search  and  compare  operation)  time  of  000.209  milliseconds  or 
209  microseconds.  This  time  represents  the  minimum  execution  time 
required  for  one  table  fetch  and  compare  operation.  As  such,  it  is 
the  minimum  time  that  the  decoder  takes  to  declare  a decoded  codeword 
when  the  codeword  is  received  without  errors  or  the  corrupting  error/ 
erasure  pattern  affects  only  the  parity  check  symbols.  This  time 
represents  a limiting  factor  on  the  decoding  rate  (see  4.1.1). 
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FIGURE  2-8:  EXAMPLE  1-NO  ERRORS  AND  NO  ERASURES 
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2.3.2  Example  2 - Five  Erasures 


Figure  2-9  shows  the  results  of  decoding  a received  codeword 
that  contains  five  erased  symbols.  Since  the  number  of  symbol  era- 
sures exceeds  twice  the  maximum  symbol  error  correcting  capability 
of  the  code  (equation  (1)),  this  received  codeword  cannot  be  decoded 
and  is  output  just  as  received  (assuming  soft  decisions  from  the  de- 
modulator). The  decoder  performance  assessment  information  shows  an 
asterisk  next  to  the  "Decoder  Codeword"  indicating  that  the  maximum 
number  of  allowable  erasures  has  been  exceeded.  The  decoding  time 
was  simply  4 microseconds,  the  time  taken  to  recognize  the  excessive 
erasure  condition  and  branch  back  to  another  received  codeword.  The 
number  of  codewords  found  is  zero  as  would  be  expected.  The  number 
of  symbol  errors  found  and  minimum  distance  (D)  found  are  both  equal 
to  8,  a program  initialization  constant  which  is  meaningless  in  this 
case.  The  number  of  symbol  erasures  found  is  five  and  accounts-for 
the  aborted  decoding  attempt. 
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FIGURE  2-9:  EXAMPLE  2-5  ERASURES 
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2.3.3  Example  3 - Two  Errors 

Figure  2-10  shows  the  decoder  performance  assessment  information 
for  a received  codeword  which  has  been  corrupted  by  an  error  pattern 
containing  two  symbol  errors.  Designating  the  right  most  symbol  in 
the  pattern  as  the  0th  symbol,  it  can  be  seen  that  the  operator  has 
declared  symbols  3 and  4 in  error.  Consequently,  the  received  code- 
word differs  from  the  encoded  (transmitted)  codeword  only  in  symbols 
3 and  4.  Since  two  symbol  errors,  in  the  absence  of  any  erased  sym- 
bols, is  an  allowable  ( i . e. , correctable)  pattern  from  equation  (1), 
a correct  decoding  operation  should  result.  Indeed,  as  Figure  2-10 
shows,  the  decoder  did  discover  two  symbol  errors,  found  one  word  in 
the  codetable  that  was  distance  two  away  and  declared  that  table 
entry  as  the  decoded  codeword.  It  will  be  seen  that  a correct  decod- 
ing occurred,  since  the  declared  "Decoded  Codeword"  is  the  same  code- 
word as  the  originally  transmitted  "Encoded  Codeword".  The  decoding 
time  of  527  microseconds  warrants  further  comment.  Since  it  is  known 
that  a period  of  approximately  209  microseconds  is  required  for  each 
codeword  table  fetch  and  compare  operation,  it  would  seem  that  this 
particular  received  codeword  required  two  table  fetches.  That  this 
was  indeed  the  case  can  be  shown  by  recalling  how  the  table  entry 
point  is  calculated.  From  the  received  codeword,  note  that  message 
symbols  6,  5,  and  4 equal  octal  152.  Note  that  symbol  4 is  in  error 
and  therefore  the  table  entry  point  is  not  at  the  ideal  location  as 
in  example  1.  However,  it  is  fortuitous  that  the  error  pattern  changed 
symbol  4 from  a value  of  3 to  £,  allowing  the  table  entry  point  routine 
to  direct  the  decoder  to  start  searching  the  table  at  a position  one 
codeword  before  the  correct  entry.  Obviously,  with  other  error  pat- 
terns the  entry  point  would  be  different  resulting  in  greater 
decode  times. 
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2.3.4  Example  4 - One  Error  and  Two  Erasures 


Figure  2-11  shows  the  decoder  performance  assessment  information 
for  a received  codeword  which  has  been  corrupted  by  an  error  and 
erasure  pattern  containing  one  symbol  error  and  two  symbol  erasures. 
From  equation  (1)  this  Is  a correctable  combination  of  errors  and 
erasures,  and  a correct  decoding  operation  should  ensue.  Referring 
to  Figure  2-11,  the  decoder  did  discover  one  error  and  two  erasures. 
The  decoding  time  in  this  example  was  8.505  milliseconds,  indicating 
that  about  40  out  of  the  512  codetable  words  were  checked  before 
finding  the  correct  entry.  Again,  this  time  is  dependent  on  how  the 
error  pattern  affects  the  message  symbols  and  therefore  the  cal- 
culated table  entry  point.  The  figure  further  indicates  that  the  de- 
coder found  one  codeword  at  a minimum  distance  of  one  symbol.  This 
minimum  distance  value  does  not  Include  the  erased  symbols  declared 
in  the  received  codeword,  as  these  symbols  are  not  counted  in  the 
symbol -by-symbol  comparison  checks.  It  is  obvious  that  the  declared 
"Decoded  Codeword"  is  the  same  as  the  "Encoded  Codeword"  and  there- 
fore a correct  decoding  has  occurred.  It  will  be  further  noticed  that 
the  distance  between  the  "Decoded  Codeword"  and  the  "Received  Code- 
word" indeed  is  equal  to  one  symbol,  not  counting  the  erased  symbols. 

It  should  be  noted  that  erased  message  symbols  are  still  util- 
ized as  received  in  the  table  entry  point  routine  but  not  in  the 
symbol  compare  operations.  In  this  particular  decoder  implementation 
the  value  of  the  "erased"  symbol  is  actually  the  correct  value  and 
thus  the  decoding  times  are  favorably  biased. 
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2.3.5  Example  5 - Three  Errors 

Figure  2-12  shows  the  decoder  performance  assessment  information 
for  a received  codeword  which  has  been  corrupted  by  an  error  pattern 
of  three  symbol  errors.  The  value  t = 3 (s  = 0)  does  not  satisfy 
equation  (1)  for  the  (7,3)  R-S  code,  and  therefore  the  error  pattern 
exceeds  the  error  correction  capability  of  the  code.  The  decoder 
will,  however,  attempt  to  decode  the  codeword  since  the  number  of 
declared  erasures  (s  = 0)  is  within  bounds.  Figure  2-12  shows  that 
the  decoder  did  indeed  recognize  that  three  symbols  were  in  error. 
However,  when  attempting  to  find  a minimum  distance  codeword,  the 
decoder  searched  the  entire  table  (requiring  134.27  milliseconds) 
and  found  that  there  were  seven  words  three  symbols  distant  from 
the  corrupted  received  codeword.  All  seven  of  these  codewords 
were  ambiguously  declared  as  choices.  Note  that  all  seven  of  these 
codewords  differ  from  the  received  codeword  by  only  three  symbols, 
and  the  originally  encoded  (transmitted)  codeword  Is  among  them. 

Such  a "list"  of  possible  codewords  can  be  viewed  as  a "partial  de- 
coding", i.e.,  reducing  the  uncertainty  in  codeword  selection  from 
one  in  512  to  one  in  seven.  Given  other  a priori  knowledge  of  the 
message  source,  such  as  its  type,  e.g.,  a slowly  varying  analog 
signal  or  redundant  video  data,  might  yield  further  clues  as  to  the 
identity  of  the  transmitted  codeword. 
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2.3.6  Example  6 - Three  Errors  and  Two  Erasures 

Figure  2-13  shows  the  decoder  performance  assessment  information 
for  a received  codeword  which  has  been  severely  corrupted  by  a 
pattern  of  three  errors  and  two  erasures.  Such  a pattern  clearly 
exceeds  the  correction-capability  of  the  (7,3)  R-S  code,  but  the 
decoder  attempts  a decoding  operation  unaware  of  this  fact.  Indeed, 
as  shown  in  Figure  2-13,  the  decoder  reported  that  it  successfully 
decoded  this  codeword  and  found  one  error  and  two  erasures,  taking 
33.178  milliseconds  to  search  approximately  one  quarter  of  the 
table  before  finding  one  codeword  that  was  distance  one  away.  Com- 
paring the  declared  "Decoded  Codeword"  with  the  transmitted  "Encoded 
Codeword",  it  can  be  readily  seen  that  they  do  not  agree  and  there- 
fore a decoding  error  has  occurred.  What  has  happened,  of  course, 
is  that  the  error/erasure  pattern  was  so  severe  that  it  "mapped" 
(changed)  the  transmitted  (encoded)  codeword  into  a corrupted 
codeword  that  was  closer  to  a different  codeword  than  the  original. 

In  fact,  comparing  the  declared  "Decoded  Codeword"  with  the  "Received 
Codeword", it  can  be  seen  that  (not  counting  erased  symbols)  only 
one  symbol  is  not  the  same,  i.e.,  the  minimum  distance  between  these 
two  since  the  occurrence  of  this  single  error  pattern  is  a much  more 
"likely"  event  than  the  triple  error  pattern  that  actually  occurred. 


FIGURE  2-13:  EXAMPLE  6-3  ERRORS  AND  2 ERASURES 
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SECTION  3 


DECODER  TESTING 


The  operational  parameters  of  the  (7,3)  R-S  decoder  were  deter- 
mined by  a series  of  tests  designed  to  exhaustively  and  randomly 
exercise  the  unit.  The  test  objectives  were  to  calculate  the 
correctness  of  decoding,  the  average  decoding  rate,  and  the  decoding 
delay. 

3. 1 Decoder  Tests  and  Results 

The  interactive  word-at-a-time  operation  described  in  Section 
2.3  successfully  decoded  all  submitted  (correctable)  error  patterns. 

To  gain  further  confidence  in  the  correctness  of  decoding,  exhaustive 
error  pattern  tests  were  run,  whereby  not  only  correct  decoding  was 
verified,  but  also  average  decoding  times  were  calculated.  To  test 
the  decoder  under  random  error  conditions,  several  Mor.te  Carlo  runs 
were  completed,  and  average  decoding  times  and  correctness  were  again 
verified. 

3.1.1  Exhaustive  Tests 

Each  of  the  (7,3)  R-S  decoder's  512  valid  codewords  was  subjected 
to  every  possible  correctable  error/erasure  pattern  shown  in  Table  I. 
This  "exhaustive"  test  ensured  that  the  decoder  could  properly  decode 
all  possible  combinations  of  the  eight  correctable  error/erasure 
pattern  types  and  also  provided  an  opportunity  to  calculate  the  aver- 
age decoding  time  for  different  error/erasure  patterns.  Table  II  shows 
the  results  of  the  exhaustive  tests,  with  columns  illustrating:  (1) 
the  correctable  error/erasure  pattern  parameters,  i.e. , the  number  of 
erasures  and/or  errors  per  pattern,  (2)  the  total  number  of  patterns 


TABLE  31  - EXHAUSTIVE  TEST  RESULTS 


NUMBER  OF 
SYMBOL  ERRORS 

NUMBER  OF 
SYMBOL  ERASURES 

NUMBER  OF  PATTERNS 
RUN  (512  x ALL  POS- 
SIBLE COMBINATIONS) 

AVERAGE 
PATTERN 
DECODING  TIME 

0 

1 

(7)  512  = 

3,584 

210m* 

0 

2 

(z) 512= 

10,752 

210m* 

0 

3 

(73)5|2  = 

17,920 

210m* 

0 

4 

(1)512* 

17,920 

210m* 

1 

1 

(*)•  2 • 7-512  = 
150,528 

29.06  m» 

1 

2 

(,)•  3*  7-512  = 
376,320 

29.06  m« 

1 

0 

({)• 7 -512  = 
25,088 

29.06  m* 

2 

0 

(l)  -7-7-512  = 
526,848 

48.23m* 
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possible  for  each  correctable  case,  and  (3)  the  average  decoding  time 
for  all  members  of  that  pattern's  family.  In  addition,  a partial  run 
(time  limited  to  three  hours)  was  conducted  for  triple  error  patterns 
(an  uncorrectable  error  pattern).  The  average  list  decoding  time  for 
this  run  was  found  to  be  120.5  milliseconds  or  89.7%  of  the  search 
time  for  the  complete  table. 

During,  the  running  of  the  exhaustive  tests  each  declared  "Decod- 
ed Codeword"  was  compared  against  the  "Encoded  (transmitted)  Codeword" 
to  verify  correct  decoding.  In  this  manner  one  bit  programmed  in 
error  in  the  codeword  table  ROMs  was  discovered  and  corrected.  This 
error  was  easily  spotted  due  to  the  consistent  failure  of  the  same 
codeword. 

3.1.2  Monte  Carlo  Tests 

In  order  to  test  the) (7,3)  R-S  decoder  under  random  error  condi- 
tions, Monte  Carlo  runs  were  employed.  The  Monte  Carlo  runs  were 
directed  by  a random  number  generator  program  written  for  the  host 
system's  CPU  (MC6800).  This  random  number  generator  program  utilizes 
"Algorithm-M"  and  employs  two  random  sub-generators:  a linear  con- 
gruential  generator  and  a maximum  length  linear  feedback  shift  regis- 
- ter.^  The  random  number  generator  was  used  to  select  random  code- 
words and  random  error/erasure  patterns  confined  to  the  eight  cor- 
rectable types  of  Table  I or  II  for  each  error/erasure  pattern 
specified,  three  runs  each  of  32,  64,  128  and  256  random  codewords 
and  patterns  were  completed.  As  in  the  exhaustive  tests,  correct 
decoding  and  average  decoding  time  were  calculated  for  each  run. 

Table  III  shows  the  results  of  the  Monte  Carlo  runs  with  columns  illus- 
trating: (1)  the  error/erasure  pattern  specified,  (2)  the  number  of 
random  runs  allowed,  and  (3)  the  average  decoding  time  per  codeword 
over  three  runs. 
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TABLE  IB  - MONTE  CARLO  TEST  RESULTS 


NUMBER  OF 
SYMBOL  ERRORS 

NUMBER  OF 
SYMBOL  ERASURES 

NUMBER  OF 
RUNS 

AVERAGE  PATTERN 
DECODING  TIME 

0 

1 

32 

210  fit 

0 

1 

64 

209  fit 

0 

I 

128 

210 

0 

1 

256 

21 0 fit 

0 

2 

32 

210  fit 

0 

2 

64 

209  fit 

0 

2 

128 

209  fit 

0 

2 

256 

210  fit 

0 

3 

32 

209  fit 

0 

3 

64 

210  fit 

0 

3 

128 

209  fit 

0 

3 

256 

210  fit 

0 

4 

32 

209  fit 

0 

4 

64 

210  fit 

0 

4 

126 

209  fit 

0 

4 

256 

210  fit 

1 

1 

32 

30.6  m* 

1 

J 

64 

24.6  mi 

1 

1 

128 

27.5m* 

1 

1 

256 

26.9m* 

1 

2 

32 

27.9m* 

1 

2 

64 

26.6  m* 

1 

2 

128 

27.6m* 

1 

2 

256 

27.4m» 

1 

0 

32 

26.6  m* 

1 

0 

64 

26.3  m* 

1 

0 

128 

28.1  m* 

1 

0 

256 

29.1  me 

2 

0 

32 

35.2  m* 

2 

0 

64 

47.5  m» 

2 

0 

128 

46.7  m* 

2 

0 

256 

5 1 . t m* 
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3.2  TEST  RESULTS  ANALYSIS 


The  results  are  analyzed  for  both  exhaustive  and  random  tests  to 

determine  the  correctness  of  the  decoding  operations  and  the  average 

execution  time  for  all  correctable  error/erasure  patterns.  For 

patterns  beyond  the  design  distance  of  the  (7,3)  R-S  code,  the  decoder 

performance  is  analyzed  with  the  aid  of  the  classic  standard  array 

r?i 

structure1-  J. 

y 

3.2.1  Correctable  Error/Erasure  Patterns 

After  correcting  a misprogrammed  bit  in  the  codeword  table 
ROMs,  the  correctness  tests  ran  without  error  for  the  exhaustive  and 
Monte  Carlo  runs.  Therefore,  it  was  proven  that  the  decoder  will  cor- 
rectly decode  all  error/erasure  patterns  satisfying  equation  (1). 

The  average  decoding  times  for  each  of  the  eight  correctable 
error  patterns  warrant  further  analysis.  Both  tests  (exhaustive  and 
Monte  Carlo)  showed  that  the  decoding  time  for  any  declared  erasure 
pattern  (in  the  absence  of  any  errors)  was  approximately  209-210 
microseconds.  This  is  easily  explained  since  the  decoding  algorithm 
ignores  erased  symbols  and  enters  the  table  at  the  correct  point  the 
first  time.  Therefore,  the  average  time  shown  is  simply  the  time 
required  for  one  table  fetch  and  compare  operation  analogous  to  Example 
1,  Figure  2-8,  for  a correctly  received  word.  It  was  mentioned  for 
decoding  Example  4 (2.3.4),  however,  that  one  critical  programming 
liberty  has  been  taken.  This  occurs  when  one  or  more  of  the  codeword's 
information  symbols  has  been  declared  erased.  In  2.2.2  it  was  assumed 
that  the  soft  decision  erased  symbol  declarations  were  accompanied  by 
"best  guess"  symbols.  In  calculating  the  table  entry  point  using 
erased  information  symbols,  however,  the  correct  (encoded)  symbol  is 
always  used.  In  other  words,  a routine  was  not  included  to  "corrupt" 


41 


r 


erased  symbols  like  symbols  which  are  in  error.  This  should  be  con- 
sidered for  future  incorporation  and  it  most  certainly  affects  average 
L-  decoding  times  for  patterns  with  erased  information  symbols. 

The  average  decoding  time  for  all  patterns  of  one  symbol  error 
and  0,  1,  or  2 erasures  from  the  exhaustive  tests  was  found  to  be 
29.06  milliseconds.  This  number  is  subject  to  the  remarks  previously 
made  relative  to  calculating  table  start  addresses  using  erased  symbol 
information.  The  random  test  runs  for  these  same  patterns  provided 
average  decode  times  that  correlated  very  closely  with  the  exhaustive 
averages.  Figure  3-1  compares  the  results  of  the  exhaustive  vs.  ran- 
dom tests  of  the  average  decoding  time  of  the  remaining  four  correct- 
able error  patterns.  The  total  aggregate  of  random  data  points  aver- 
ages out  to  be  only  5.6%  below  the  decoding  time  of  the  exhaustive 
tests  for  the  first  three  patterns,  a figure  highly  dependent  on  the 
sample  size  of  the  random  runs  and  the  bias  of  the  random  number  gen- 
erator. For  the  two  error  and  no  erasure  pattern',  the  small  random 
sample  run  ( i . e . , n = 32)  is  seen  to  be  below  the  exhaustive  average 
by  27%.  However,  the  random  decoding  times  for  this  pattern  correlate 
quite  well  with  the  exhaustive  test  results  for  larger  sample  runs, 
and,  in  fact,  the  aggregate  of  the  four  points  averages  only  6.4%  be- 
low the  average  decoding  time  of  the  exhaustive  tests. 

3.2.2  Uncorrectable  Error/Erasure  Patterns 

Rather  extensive  investigation  was  carried  out  relative  to  decod- 
er performance  for  error/erasure  patterns  which  do  not  satisfy  equation 
(1)  and  lie  therefore  beyond  the  design  distance  of  the  (7,3)  R-S  code. 
Since  the  decoder  decodes  every  possible  received  word  into  one  (or 
more)  possibly  transmitted  codewords,  it  exhibits  a complete  decoding 
algorithm  and  is  not  a bounded-distance-decoder  In  the  strict  sense^. 
Specifically  investigated  were  error-only  patterns  of  weight  three  and 
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Figure  3-1  : EXHAUSTIVE  VS.  RANDOM  TEST  RESULTS 


four.  In  order  to  better  understand  the  decoder  performance  when 
operating  on  valid  codewords  corrupted  with  error  patterns  of  such 
weight,  it  is  expedient  to  look  at  a standard  array  representation 
of  the  (7,3)  R-S  code.  There  is  no  need  to  completely  fill  in  the 

n oi 

2 = 2 array  values,  but  an  enumeration  of  the  number  of  differ- 
ently weighted  words  is  helpful  in  understanding  decoder  operation. 
Using  the  MacWilliams'  formula  to  find  the  weight  distribution  of  a 
maximum-distance-separable  code^ 

j-l-(n-k) 

A.  = (")  E (-l)h  (j)  (qJ-Mn-k)_1}  (3) 

J J h=0 

the  (7,3)  Reed-Solomon  code  exhibits  parameters  of  n=7,  q=8,  k=3,  and 
n-k=4.  Equation  (3)  allows  the  calculation  of  the  number  (A^)  of 
codewords  of  weight  j as: 


Ai  A2  — A^  — A^  — 0 
A5  = A6  = 147 
A?  = 217 

7 . 

where, Z Ai  = qK  = 512  codewords.  Forming  the  (7,3)  R-S  Standard 
j=0  J 

Array,  the  first  row  contains  the  512  valid  codewords.  The  coset 

leaders  of  the  next  1078  rows  are  the  correctable  error  patterns, 

7 7 2 

first, (-j)  = 49  single  error  patterns, then  (g)7  = 1029  double  error 

patterns.  The  interior  of  the  array  is  the  result  of  adding 

appropriate  row  and  column  leaders.  Knowing  the  weight  distribution 

of  the  valid  codewords,  and  from  R-S  code  theory  that  d = n-k  + 1 

and  t = 2,  it  is  seen  that  all  single  and  double  error  patterns  are 


correctable.  Thus  the  weight  distribution  of  the  interior  of  the 
array  can  be  readily  calculated  since  all  single  and  double  error 
patterns  are  present.  For  example,  the  number  of  words  of  weight 
six  which  are  formed  by  combinations  of  valid  codewords  and  the 
double  error  patterns  (weight- two  words)  can  be  calculated  by  con- 
sidering the  various  ways  in  which  these  combinations  are  possible. 
First,  weight-6  words  can  be  formed  from  weight-7  codewords  added  to 
a weight-2  error  pattern  where  the  mod-2  sum  of  one  error  symbol  and 
one  codeword  symbol  equals  zero,  and  the  sum  of  the  other  error  sym- 
bol and  a codeword  symbol  results  in  a different  non-zero  symbol. 
Likewise,  a weight-6  word  will  result  from  a six-weight  codeword 
where  two  non-zero  symbols  are  changed  by  the  two  error  pattern  sym- 
bols into  two  other  non-zero  symbols.  Furthermore,  a six-weight 
codeword  can  be  combined  with  a two-weight  error  such  that  one  non- 
zero error  symbol  value  adds  to  a zero  symbol  of  the  codeword  while 
the  other  non-zero  error  symbol  value  exactly  equals  the  correspond- 
ing symbol  of  the  codeword  and  yields  a zero  symbol.  Lastly,  a 
five-weight  codeword  can  combine  with  a two-weight  error  pattern 
whereby  one  non-zero  codeword  symbol  is  added  to  one  non-zero  error 
symbol  resulting  in  a different  symbol,  and  one  zero  symbol  of  the 
codeword  is  added  to  the  other  non-zero  symbol  of  the  error  pattern 
resulting  in  a new  non-zero  symbol.  Mathematically,  these  combina- 
tions can  be  calculated  as: 

W62  = (1)(1}  6'217  + (2)fi2  ' 147  + 7'6  ' 147  + 7(^'6'2  ' 147  = 

201,978  (4) 

Figure  3-2  illustrates  the  structure  of  the  standard  array  for 
the  (7,3)  R-S  code  with  the  calculated  array  weight  enumerators  in- 
cluded for  the  correctable  error  patterns  only.  Considering  for  a 
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Figure3-2:  (7,3)  R-S  STANDARD  ARRAY 


moment  array  members  of  weight  three,  the  figure  shows  that  1470  of 
these  result  from  combinations  of  two-weight  error  patterns  and  valid 
codewords  of 


“j-E2*  (5) 

where:  W3  = interior  array  words  of  weight  three 
E2  = double  error  pattern 
C.  = any  i*"*1  codeword 

If  one  of  these  three-weight  words  is  an  error  pattern  that  corrupts 

a transmitted  valid  codeword  C.,  then: 

J 

Cj  + W3  = Cj  + E2  + Ci  = E2  + Ck  (6) 

where  + Cj  = by  the  group  property  of  the  linear  block  code. 

Equation  (6)  indicates  that  1470  weight-3  error  patterns  will 
"map"  any  transmitted  codeword  closer  (distance  2)  to  another  valid 
codeword.  What  of  the  remaining  three-weight  error  patterns?  There 
is  a total  of  (3)7  = 12,005  weight-3  error  patterns.  Since  it  has 
just  been  shown  that  1470  of  these  result  in  incorrect  decodings,  the 
remaining  10,535  triple  error  patterns  must  result  in  corrupted  code- 
words that  are  at  least  distance  three  away  from  one  or  more  codewords. 
Figure  3-2  shows  that  a maximum  of  3017  of  these  patterns  can  be 
arbitrarily  declared  coset  leaders,  and  therefore  a "standard  array 
decoder"  could  ambiguously  decode  3017  out  of  the  12,005  or  25%  of  all 
triple  error  patterns.  The  (7,3)  R-S  decoder  algorithm  under  consid- 
eration here,  will  "decode"  10,535  corrupted  codewords,  87.8%  of  the 
total  triple  error  patterns,  to  a list  of  possibly  transmitted  code- 
words. Extensive  decoding  runs  have  confirmed  that  this  list  size 
is  always  <_  7. 
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Considering  four-weight  (quad)  error  patterns,  further  runs 
showed  that  490  out  of  the  84,035  possible  four-weight  error  patterns 
(0.6%)  corrupting  any  transmitted  codeword  result  in  a decoded  list 
of  35  possibly  transmitted  codewords.  62,965  (75%  of  all)  quad 
error  patterns  map  any  transmitted  codeword  distance  3 away  from  7 or 
fewer  valid  codewords  (all  incorrect).  As  shown  in  Figure  3-2, 

19,845  (24%  of  all)  quad  error  patterns  map  any  transmitted  codeword 
distance  1 away  from  1 valid  codeword.  These  last  two  cases  appear 
as  "proper  decodes"  from  the  decoder's  point  of  view,  but  are  in 
fact  incorrect. 


SECTION  4 
CONCLUSIONS 


The  design,  construction,  and  testing  of  the  microprocessor- 
based  (7,3)  R-S  decoder  resulted  in  many  interesting  conclusions. 

Analysis  of  the  decoder's  performance  enables  simple  conclusions  to 
be  made  relative  to  the  decoding  rates  obtainable  and  the  decoding 
delay.  Conclusions  are  also  drawn  relative  to  system  lessons  learned, 
testing  error  coding  systems,  and  improving  decoder  performance. 

4.1  SYSTEM  IMPLICATIONS 

If  this  simple  (7,3)  R-S  decoder  were  to  be  used  as  a design  re- 
source in  the  engineering  of  a communications  channel,  its  operation 
would  certainly  affect  the  reliability  and  performance  of  that  channel. 
System  design  aspects,  such  as  buffering  requirements,  depend  to  a 
large  extent  on  the  decoding  rate  and  delay  of  the  decoder,  while  de- 
coding rates  obtainable  affect  channel  rates  and  consequently  throughput. 

4.1.1  Average  Decoding  Rate 

Since  the  decoding  time  per  codeword  is  dependent  on  the  partic- 
ular error/erasure  pattern  that  corrupts  the  word,  the  decoding  rate 
will  vary.  Figure  4-1  shows  the  average  decoding  rate  of  the  (7,3) 

R-S  decoder  vs.  symbol  error  rate.  The  abscissa  of  the  graph  is  de- 
fined in  both  information  symbols  per  second  and  information  bits  per 
second,  the  latter  being  three  times  the  former  since  one  eight-level 
symbol  is  the  equivalent  of  three  bits  of  information.  Assuming  that 
the  (7,3)  R-S  decoder  is  matched  to  an  m-ary  (8-level)  channel,  the 
ordinate  relates  the  random  error  rate  on  the  channel  relative  to  the 
independent  transmission  of  symbols.  The  dashed  line  on  the  graph  is 
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Figure  4-1  : DECODING  RATE  vs  SYMBOL  ERROR  RATE 


an  asymptote  of  14,354  symbol/sec.  In  2.3.1  and  3.2.1  it  was  shown 
that  209  microseconds  is  the  minimum  decoding  time  obtained  when 
only  one  table  fetch  and  compare  operation  is  necessary.  Therefore, 
the  reciprocal  of  this  time  (i.e.,  1/209  x 10’®)  represents  the 
maximum  decoding  rate  obtainable  In  all  codewords  were  received  cor- 
rectly or  if  correctable  error  patterns  are  confined  to  check  symbol 
positions  only.  The  curve  relating  the  average  decoding  rate  for  a 
given  symbol  error  rate  was  calculated  via  equation  (7): 


(SER) 


« °e 


+ P 


+ P, 


+ P, 


1E,C  ' ’ 2E,c  + 1E,m  2E,m  + 3E 
209  x 10’6  67  x 10’*  134  x 10"3 


(7) 


where 


R(SER)  = 


average  decoding  rate  at  some  specific 
symbol  error  rate  (SER) 


PiE  = the  probability  of  receiving  a codeword 
with  i errors  at  the  specified  SER 

= (7)  SER1  (l-SER)7’1 

P.r  = the  probability  of  receiving  a codeword 

1 L 9 C 

with  i errors,  all  of  which  are  confined 
to  the  check  symbol  positions 

P.E  m = the  probability  of  receiving  a codeword 
with  i errors,  one  or  more  of  which  are 
located  at  a message  symbol  location 


_2 

As  the  curve  shows  for  SERs  better  than  approximately  10  most  sym- 
bols are  received  correctly  and  the  rate  asymptotically  approaches 
the  correct  codeword  recognition  limit.  It  must  be  remembered  that 
these  rates  were  obtained  using  a 1 MHz  CPU  chip.  A 2 MHz  6800B  CPU 
chip  would  result  in  a doubling  of  these  rates. 
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4.1.2  Decoder  Delay 


Like  the  instantaneous  decoding  rate,  the  delay  inherent  in  the 
operation  of  the  (7,3)  R-S  decoder  varies  with  the  error/erasure 
pattern.  Obviously,  the  longest  decoding  delay  results  from  a com- 
plete codeword  table  search  and  is  approximately  134  milliseconds. 

The  probability  that  a correctable  error  pattern  of  one  or  two  errors 
will  corrupt  message  symbols  (hence  the  table  entry  point)  is 
approximately  (from  equation  7) 


P *=  Pi  r m + Por  m 
lE,m  2E,m 


(8) 


Assuming  that  this  corruption  always  results  in  an  entire  table 

search,  equation  (8)  is  a loose  upper  bound  on  the  probablity  of  this 

event.  For  example  the  likelihood  of  this  event  for  symbol  error 
_o 

rates  below  10  is  less  than  .029  due  to  correctable  error  patterns, 
and  it  is  less  than  .000034  for  uncorrectable  error  patterns. 

Good  system  design  dictates  the  incorporation  of  a codeword  buf- 
fer. The  width  of  the  codeword  buffer  will,  in  general,  be  seven 
symbols  or  21  bits,  while  the  depth  is  dependent  on  decoder  delay  and 
channel  rate.  Choosing  a particular  channel  transmission  rate,  the 
channel's  information-transfer  efficiency,  i.e.,  the  throughput,  can 

f5l 

be  calculated1-  J.  Many  factors  influence  a channel's  throughput  rate, 
such  as  the  channel's  transmission  rate,  the  amount  of  overhead  sym- 
bols dedicated  to  control  synchronization  and  coding  redundancy, 
channel  error  rate,  and  block  length.  Ideally,  the  decoding  rates  of 
Figure  4.1  for  known  channel  error  conditions  could  be  used  to  set 
the  channel  transmission  rate.  Consequently,  enough  buffer  depth  must 
then  be  designed  to  hold  received  codewords  during  intervals  of  de- 
coding that  are  longer  than  the  reciprocal  of  the  instantaneous  trans- 
mission (decoding)  rate.  Without  resorting  to  a detailed  queueing 
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analysis,  a heurlstlcally  engineered  buffer  design  can  be  proposed. 

For  example,  at  a symbol  error  rate  of  10  , the  average  decoding 

rate  shown  In  Figure  4-1  Is  approximately  13,800  information  symbols 
per  second  (l.e.,  4600  codewords  per  second  or  41.4  Kb/s).  If  this 
is  set  as  the  channel  transmission  rate,  then  the  buffer  must  be 
large  enough  to  hold  received  codewords  during  the  longest  decode 
time  - 135  milliseconds  for  a complete  table  search.  This  estab- 
lishes a buffer  length  of  (134  x 10”^)(4600)  * 616  codewords  of 
21  bits/codeword,  or  1.6  K bytes.  The  probability  of  a complete 
table  search  (Pcts)  from  (8)  Is  .029.  The  probability  of  buffer 
overflow  due  to  two  complete  table  searches  In  a sequence  of  616  code- 
words is  (^)Pcts  0"Pcts^^  * 2-264  x 10"®.  Conservatively  design- 
ing a buffer  twice  this  estimate  size  or  3.2K  bytes  would  provide 
an  extremely  low  probability  of  over/under- flow  and  would  at  the 
same  time  not  become  a hardware  burden.  Where  hardware  constraints 
are  critical  and  information  rate  Is  not,  setting  the  transmission 
rate  lower  than  the  decoding  rate  provides  the  opportunity  for  a 
tradeoff  between  buffer  size  and  throughput  as  well  as  extended 
performance  with  larger  codes  and/or  list  decoding  techniques. 

4.2  LESSONS  LEARNED 

From  the  construction  and  testing  of  the  simple  (7,3)  R-S 
decoder  a number  of  lessons  learned  and  conclusions  can  be  related: 

1.  8-blt  M0S  microprocessors  can  do  error  coding/decoding 
operations  at  reasonable  decoding  rates  with 
minimum  hardware  If  small  block  codes  are  utilized. 

The  key  to  utilizing  low-cost  8-blt  M0S  microprocessors 
for  error  coding  lies  in  restricting  the  chosen  code  to  a 
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short  block  length,  and  using  simple  decoding 
algorithms  with  table-look  up  procedures  wherever 
possible.  As  future  generations  of  microprocessors 
become  more  powerful,  these  restrictions  can  un- 
doubtedly be  relaxed. 

In  representing  q-ary  code  symbols  in  binary-based 
microprocessor  designs,  codeword  representation  is 
critical  in  order  to  minimize  decoding  time.  The 
binary  representation  of  q-ary  code  symbols  must  be 
designed  to  make  maximum  use  of  the  microprocessor's 
instruction  set. 

Simple  decoding  algorithms  will  achieve  minimum 
execution  time  if  in-line  code  (i.e.,  no  subroutine 
calls,  loops,  etc.)  is  extensively  used  in  critical 
portions  of  the  program.  This  results  in  a tradeoff 
between  memory  storage  requirements  and  execution 
speed,  a viable  alternative  given  the  current  trend 
of  increasing  memory  densities  and  lower  per/bit 
costs  of  semiconductor  RAM/ROM. 

Using  a maximum-likelihood  decoding  algorithm  with 
table  look-up,  smart  table  search  procedures  must 
be  implemented  to  speed  table  search  times.  Using 
certain  symbols  of  systematic  or  nonsystematic 
codes,  table  entry  points  can  be  calculated  that 
result  in  highly  possible  minimum  table  search 
time. 

Having  decoded  to  a valid  codeword,  faster  message 
extraction  is  facilitated  by  the  use  of  systematic 
codewords  obviating  the  necessity  of  a final  poly- 
nomial divide  operation.  Alternatively,  when  using 


non- systematic  codes  memory  storage  for  the  corres- 
ponding message  symbols  can  be  traded  off  against 
the  added  execution  time  of  a polynomial  divide 
operation. 

6.  The  Instruction  set  of  a microprocessor  establishes 
the  capability  of  that  CPU  to  efficiently  perform  a 
given  decoding  algorithm.  The  lack  of  or  inclusion 
of  certain  Instructions  may  dictate  an  entirely  dif- 
ferent coding  approach  for  the  algorithm  resulting 
In  radically  different  execution  times  and  memory 
storage  requirements. 

7.  The  amount  of  data  and  program  storage  space  neces- 
sary to  implement  the  (7,3)  R-S  decoder  in  a multi- 
chip microprocessor  configuration  easily  lends 
itself  to  an  economical  design  utilizing  some  of  the 
state-of-the-art  one  chip  microcomputers  such  as  the 
MOSTEK  3870. 

4.3  ERROR  CODING  SYSTEM  TESTING 

Experience  gained  in  testing  the  microprocessor-based  (7,3)  R-S 
decoder  has  provided  the  basis  for  a general  test  methodology  for 
error  coding  systems.  Whereas  exhaustive  error/erasure  pattern  tests 
on  the  (7,3)  decoder  were  feasible  due  to  the  short  block  lengths,  and 
the  small  number  of  bits  per  symbol,  such  tests  would  be  prohibitively 
long  running  on  larger  codes.  In  fact,  even  for  the  (7,3)  R-S  decoder 
error/erasure  patterns  larger  than  three  symbols  were  not  run  due  to 
the  size  of  the  combination  set  (e.g.,  823,543  for  6-symbol)  error/ 
erasure  patterns).  It  may,  however,  In  many  Instances  be  feasible  to 
exhaustively  run  all  guaranteed  correctable  error/erasure  patterns.  From 
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such  tests  correct  decoding  could  be  verified  for  a bounded  distance 
decoder,  and  statistical  data  on  decoding  times  could  be  gathered. 

For  longer  codes  and  more  sophisticated  decoding  methods,  some  sort 
of  Monte  Carlo  random  simulation  testing  makes  the  most  sense.  With 
a statistically  verifiable  Monte  Carlo  exercising  program,  decoder 
performance  could  be  quickly  assessed  under  varying  message  source 
and  error  environment  conditions.  Complete  decoder  evaluation  is 
difficult  without  knowledge  of  the  particulars  of  the  system  in  which 
it  will  be  employed.  Lacking  this  information,  assumptions 
can  be  made  relative  to  desired  channel  transmission  rates,  error 
conditions,  synchronization  and  control  overhead  schemes,  to  enable 
the  calculation  of  total  system  throughput.  From  these  preliminary 
findings  the  assumed  parameters,  as  well  as  the  error  coding  para- 
meters, can  be  varied  to  achieve  the  desired  system  performance. 
Decoder  test  data  is  invaluable  in  this  respect  ensuring  a certain 
level  of  performance  from  the  stand-alone  decoder. 

4.4  (7,3)  R-S  DECODER  IMPROVEMENTS 

While  analyzing  the  test  results  of  the  (7,3)  R-S  decoder.  It 
becomes  apparent  that  one  design  assumption  led  to  a slight  bias- 
ing of  the  decode  times.  As  reported  in  3.2.1,  this  event  arises  from 
codeword  table  entry  point  calculations  using  erased  symbols.  It  was 
stated  that  a soft-decision  demodulator  would  pass  code  symbol  esti- 
mates to  the  decoder  along  with  a confidence  measure,  which  in  the 
simplest  case  is  an  erased/not-erased  indicator.  The  (7,3)  R-S  de- 
coder as  tested,  however,  does  not  quite  approximate  this  operation. 
The  problem  comes  about  from  the  fact  that  the  operator-  (or  random 
generator)  entered  codeword  erased  symbols  are  not  corrupted,  but  are 
passed  unchanged  to  the  table  entry  point  routine.  This  biases  the 
decoding  times,  since  the  correct  table  entry  usually  results.  The 


decoder  operation  should  be  changed  to  corrupt  these  erased  symbols 
for  a more  accurate  simulation.  Having  done  this,  the  danger  then 
exists  that  If  the  "best  guess"  erased  symbol  Is  a message  symbol  It 
may  cause  the  table  entry  point  routine  to  start  table  search  "beyond" 
the  correct  codeword  resulting  in  abnormally  long  table  searches. 
Fortunately,  there  is  an  easy  "algorithm  fix"  for  this  eventuality. 

If  a declared  erased  symbol  is  the  least  significant  or  next  to  least 
significant  message  symbol  (symbols  4 and  5,  Figure  2-5),  the  code- 
word table  entry  point  routine  shall  replace  the  best-guess  value  of 
these  symbols  with  zero.  This  will  ensure  that  the  table  entry  point 
is  not  beyond  the  correct  codeword  location  if  the  most  significant 
message  symbol  is  correct.  Setting  symbol  4 = 0 results  in  a worse 
case  search  of  8 codewords.  Likewise,  symbol  5=0  may  result  in  a 
search  of  up  to  64  codewords.  Unfortunately,  this  fix  will  not  re- 
sult in  any  average  time  savings  if  applied  to  message  symbol  6. 

This  "fix"  is,  in  essence,  making  use  of  the  erasure  symbol  informa- 
tion (i.e.,  the  location  of  a possible  symbol  error  is  known).  Using 
this  information,  the  algorithm  can  ensure  that  maximum  table  searches 
will  not  occur  for  error  patterns  satisfying  the  three  following  con- 
ditions : 

1.  A correctable  error/erasure  pattern  is  involved. 

2.  Message  symbol  6 is  not  erased  nor  in  error. 

3.  Message  symbol  5 and/or  4 may  be  erased. 

Additionally,  this  procedure  may  be  employed  dependent  on  other  soft- 
decision  information  from  the  demodulator  (e.g.,  received  S/N  ratio) 
indicating  the  degree  of  confidence  in  the  declared  symbol. 

Recent  work  on  simple  (7,3)  R-S  decoder  implementations  done  by 
others  on  Project  7010  and  documented  elsewhere  has  resulted  in 
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considerable  improvement  in  decoder  operation.  By  using  multiple 
codetables,  minimum  symbol  storage.and  simple  finite  field  arithmetic 
operations,  decoder  performance  can  be  dramatically  improved  over 
the  results  reported  on  here. 
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